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ABSTRACT 

Number  of  Targets  Threatened  Simultaneously  (NOTTS)  is  a  measure  of  the 
presence  (in  a  background  of  unknowns)  of  a  surprise  attack  on  the  U.S. 
retaliatory  force. 

Vour  NOTTS  indicators  PEAK,  KURTOSIS,  RIDGE,  and  P1,P2  and  P3  are  defined 
and  evaluated  using  the  J5YA  Raid  Recognition  Algorithm  for  a  bomber  or  cruise 
missile  raid  against  SAC  and  C^  target  sets.  Scatter  charts  showing 
background  noise  produced  by  commercial  traffic,  and  raid  plus  noise  combined 
are  presented  and  used  to  describe  the  setting  of  reaction  thresholds.  The 
effect  of  time  of  day,  probability  of  radar  detection,  and  the  choice  of 
target  set  and  raid  design  on  reaction  threshold  are  discussed. 

Although  ideal  settings  of  indicators  are  practical  In  the  cases 
discussed,  attention  is  drawn  to  the  limited  data  available  for  modeling  of 
unknowns  In  OTHE  coverage. 
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Number  of  Targets  Threatened  Simultaneously  (NOTTS) 
In  conjunction  with 

Over  the  Horizon  Back-Scatter  (OTHB)  Radar  Coverage 


I.  PURPOSE 

The  purpose  of  this  paper  is  to  review  progress  in  the  development  and 
evaluation  of  NOTTS  raid  recognition  Indicators. 

II.  THE  PROBLEM 

A  missile  attack  on  North  America  Is  deterred  by  the  enemy's 
calculation  of  the  damage  to  their  homeland  caused  by  the  surviving  U.S. 
retaliatory  force. 

A  surprise  attack  on  North  America  (If  It  were  successful),  could 
destroy  Strategic  Air  Command  (SAC)  Main  Operating  Bases  (MOBs),  thereby 
removing  SAC  from  the  enemy's  damage  calculation.  A  surprise  attack  could 
also  attack  Command,  Control,  and  Communications  (C^)  sites  required  to  launch 
land-based  ICBMs,  thereby  delaying  launch  by  perhaps  half  an  hour.  The 
land-based  ICBMs  can  also  become  vulnerable  to  a  missile  attack  and  can  be 
removed  from  the  damage  calculation,  and  destruction  of  C^  sites  may  cause 
problems  for  the  submarine  arm,  lowering  calculated  damage  further.  A 
surprise  bomber  or  cruise  missile  attack  reduces  the  deterrent  against  a 
missile  attack. 

The  purpose  of  deterring  a  surprise  bomber  or  cruise  missile  attack 
is  to  prevent  the  deterrent  value  of  the  Triad. 
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in.  NOTTS  FEATURE 

A  surprise  attack  must  destroy  Its  last  target  within  a  few  minutes 
of  the  first  target  struck.  Otherwise,  the  surprise  attack  falls  since  the 
destruction  of  the  first  targets  provides  tactical  warning,  which  the  attack 
alms  to  deny.  Therefore,  the  number  of  targets  which  the  surprise  attack 
threatens  nearly  simultaneously,  must  be  the  full  target  set. 

Consequently,  If  the  means  were  available  to  detect  aircraft 
approaching  North  America,  an  estimate  of  the  number  of  key  targets  threatened 
simultaneously  would  show  many  targets  threatened  If  these  incoming  aircraft 
or  cruise  missiles  were  participating  In  a  surprise  attack. 

The  acronym  NOTTS  represents  the  number  of  targets  threatened 
simultaneously.  A  surprise  attack  need  not  have  the  NOTTS  feature,  but  a 
surprise  attack  which  affects- the  deterrent  does. 

Although  an  actual  raid  produces  a  large  value  of  NOTTS,  what  about 
Incoming  commercial  traffic?  The  large  volume  of  commercial  traffic  creates 
a  background  of  "noise",  but  this  traffic  was  not  designed  to  threaten 
North  America,  and  hence  should  not  generate  significant  NOTTS  values. 

IV.  NOTTS  INDICATORS 

To  shed  some  light  on  the  value  of  the  NOTTS  feature  in 
dlscrlmlitatlng  a  bomber  or  cruise  missile  attack,  several  raid  Indicators 
based  or  NOTTS  were  defined. 
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PEAK 

A  NOTTS  diagram  la  shoira  In  Figure  1.  This  diagram  presence  Che 
rasulCs  of  Che  evaluaClon  of  NOTTS  for  Che  NORAD  daCa  base  of  unknowns  as  Ic 
exlsCed  ac  1200  hours.  An  unknown  can  reach  one  cargeC  aC  1245  hours.  Two 
unknowns  can  reach  Cwo  CargeCs  simulCaneously  aC  1300  hours.  AC  1400  hours 
NOTTS  has  a  value  of  4,  and  by  1500  hours  NOTTS  has  dropped  Co  1. 

The  maximum  helghc  of  Chis  diagram  will  be  called  Che  PEAK  indicaCor. 


NOTTS 


Figure  1 
PEAK 
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IsUKTOSlS 

The  PEAK  Indicator  will  nave  Che  sa.iie  value  for  either  Figure  2a  or 
jl  bur.  Figure  2b  has  a  more  sharply  defined  spike.  Therefore,  KURTOSIS 
which  measares  -he  peakedness  of  the  NOTTS  diagram  was  Introduced  as  a  second 
NOTTS  Indicator.  KURTOSIS  uses  the  fourth  moment  about  the  origin  as  follows: 


KURTOSIS  -  -V 
4 


where, 


4  .  2v2 

o  ■»  (o  ) 


Y  NOTTS  value  for  each  time  period 


p  »  Mean  of  NOTTS  over  entire  time  period 


N  ••  Total  NOTTS  over  entire  time  period 


or  ■  Variance  of  NOTTS 


The  KURTOSIS  value  for  each  NOTTS  diagram  was  scaled  by  multiplying  by 
the  number  of  targets  threatened  for  the  entire  diagram.  The  scaled  KURTOSIS 
values,  however,  were  small  for  more  sharply  defined  spikes.  Therefore,  the 
reciprocal  of  the  scaled  KURTOSIS  values  were  used  as  an  indicator  of 
peakedness  since  the  reciprocal  increases  with  more  sharply  defined  spikes. 
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RIDGE 

A  single  NOTTS  diagram  Is  Che  latest  in  a  series,  and  the  PEAK  and 
KURTOSIS  Indicators  are  obtained  from  Che  current  NOTTS  diagram.  The  third 
Indicator  called  RIDGE  summarizes  a  series  of  NOTTS  diagrams.  Figure  3b 
shows  the  latest  NOTTS  diagram^  prepared  at  1200  hours,  and  Figure  38  Is  the 
previous  diagram,  prepared  at  1100  hours.  RIDGE  for  1230  hours  Is  obtained  by 
adding  heights  for  this  time  (l.e.,  1  -f  6  +  .  .  ..  ).  In  practice,  ridges  are 
calculated  for  each  time  Interval  on  the  current  NOTTS  diagram  and  Che  largest 
Is  chosen  as  the  RIDGE  Indicator. 


NOTTS 


Time 

Figure  3a 
RIDGE 

(1100  hours) 
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NOTTS 


Time 

Figure  3b 
RIDGE 

(1200  hours) 


PI,  P2.  and  P3 

The  fourth  indicators  are  the  probabilities  of  a  surprise  attack  being 
a  1  on  1,  2  on  1,  or  3  on  1  raid*  In  other  words,  what  is  the  probability 
that  each  target  is  being  threatened  by  one,  two,  or  three  unknowns?  These 
indicators  are  called  PI,  P2,  and  P3  and  are  calculated  using  a  Chi-Square 
Goodness  of  Fit  test  which  compares  the  number  of  unknowns  threatening  a 
target  to  the  number  expected  to  threaten  a  target  if  the  raid  were  a  1  on  1, 

2  on  1,  or  3  on  1  attack.  To  illustrate,  the  following  example  shows  10 
targets  being  threatened  by  either  0,  1,  or  2  unknowns. 
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Tarfeet  // 
1 
2 

3 

4 

5 

6 

7 

8 

9 

10 


Unknowns  Observed 
Case  I  Case  II 


0 

0 

1 
1 
0 
1 
1 

2 
1 
1 


2 

1 

2 

2 

1 

0 

1 

2 

2 

1 


Using  Che  Chi-Square  Goodness-of-Flt  Test  on  Case  I  yields 
probabilities  of  approximately  *90  and  .10,  for  a  1  on  1  and  2  on  1  attack, 
respectively.  Case  II,  however,  yields  probabilities  of  approxlnuttely  .75  and 
.90.  These  results  show  that  Case  I  is  most  likely  a  1  on  1  attack,  while 
Case  II  appears  to  be  a  2  on  1  attack.  The  same  data  can  be  extended  for  a  3 
on  1  raid.  Although  this  methodology  violates  the  assumption  of  an  expected 
frequency  of  at  least  2  In  each  class,  it  does  give  an  indication  of  relative 
probability. 
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V.  DEVELOPMENT  OF  DATA  BASE  OF  UMKNOWNS 

Evaluation  of  these  Indicators  will  be  based  on  the  current  data  base 
of  unknowns  at  NORAD.  This,  in  turn,  will  be  based  on  reports  from  the 
Northern  Uarning  System  (NWS),  the  Over-the-Horizon  Backscatter  radar  system 
(OTHB),  and  the  Regional  Operational  Control  Centers  (ROCCs). 

Since  this  data  base  does  not  yet  exist,  a  method  of  constructing  a 
data  base  was  developed  for  this  evaluation.  The  method  provides  a  dynamic 
data  base  by  simulating  the  air  traffic  on  its*  routes  and  reexamining 
positions  every  minute.  Figure  4  shows  the  development  of  the  data  base  and 
its'  application  by  the  raid  recognition  algorithm.  In  the  example  shown,  a 
hostile  raid  and  background  commercial  traffic  are  present. 


Standard  Raids  and  Targets 


Figure  3a  shows  a  raid  design  which  consists  of  a  standard  30  bomber 
raid  against  a  standard  target  set  consisting  of  30  SAC  and  C^  targets.  The 
design  provides  for  simultaneous  Impact  using  bombs  against  hard  targets  and 


deploying  ASMs  (along  the  dotted  routes  in  Figure  3a)  against  soft  targets. 

Figure  3b  depicts  a  raid  design  consisting  of  34  cruise  missiles 
launched  from  seven  cruise  missile  carriers. 

Figure  6  shows  the  number  of  raid  tracks  in  NWS  and  OTHB  coverage 
during  the  progress  of  the  attack.  One  or  more  cracks  are  in  coverage  over  a 
period  of  eight  hours  and  approximately  20  for  three  hours. 
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Background  Traffic 

The  commercial  traffic  includes  30  aircraft  routes  Inbound  from 
the  east*  which  were  extracted  from  the  Federal  Aviation  Administration  (FAA) 
sponsored  Oceanic  System  Improvement  (OASIS)  Study.  There  are  369  tracks, 
and  the  number  In  OTHB  coverage  la  shown  In  Figure  7,  The  hourly  variation 
Is  extreme,  reaching  a  peak  of  around  110  tracks  at  1600  ZULU,  and  this 
variation  suggests  that  reaction  levels  can  be  lowered  during  off-peak 
periods  to  provide  more  sensitivity  In  detecting  raids  during  these  periods. 

In  practice,  background  traffic  will  also  Include  coanerclal  traffic 
Inbound  from  other  directions.  However,  a  good  description  of  Che  latter  has 
not  yet  been  obtained. 

Detection  Probability  and  Classification 

Returning  to  Figure  4,  the  first  step  In  constructing  Che  data  base 
is  to  determine  whether  a  given  crack  Is  detected.  One  way  to  do  this  Is  to 
draw  a  random  number  for  each  Crack  and  to  accept  cracks  whose  random  number 
la  less  than  the  detection  probability.  The  detection  probability  will  be 
provided  to  the  NCMC  (NORAD  Cheyenne  Mountain  Complex}  for  each  7*  sector  of 
OTHB  coverage.  A  system  value  can  be  obtained  by  (a)  averaging  sector  values, 
(b)  choosing  the  worst  value,  (c)  weighting  by  sector  raid  probability,  and 
(d)  weighting  by  number  of  commercial  flight  plans.  The  system  values  studied 
are  0.90  and  0.50. 

Once  Che  detected  Cracks  have  been  identified,  the  next  step  is  to 
classify  the  tracks  as  known  or  unknown.  Experience  with  the  Experimental 
Radar  System  (ERS)  Indicates  that  94Z  of  detected  commercial  Cracks  were 
correlated  with  flight  pljtns,  leaving  bX  of  these  as  unknown.  Again,  random 
numbers  were  drawn  to  select  the  unknown  commercial  tracks. 
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Data  Baae 

The  timing  of  the  bomber  raid  was  phased  to  coincide  with  peak 
commercial  traffic,  which  causes  Impact  to  occur  at  2000  hours  ZULU  (4400 
hours  OASIS). 

The  cruise  missile  raid,  however,  was  designed  to  have  simultaneous 
Impact  of  all  cruise  missiles  at  4400  hours  OASIS. 

The  simulation  moves  the  unknown  airccaf t  and  cruise  missiles  along 
their  respective  tracks  by  one  minute  increments,  and  radar  detection  occurs 
when  an  aircraft  or  cruise  missile  enter  radarvcover  (approximately  1700  nm 
for  OTHB  and  1480  nm  for  NWS).  See  Appendix  8  for  a  description  of  the  OTHB 
and  NWS  radar  coverages.  The  data  base  of  unknowns  was  then  augmented  to 
include  the  new  unknowns. 

VI.  RAID  RECOGNITION  ANALYSIS 
Methodology 

The  raid  recognition  algorithm  examines  the  data  bank  of  unknoims 
every  half  hour. 

Step  1 

The  first  step  shown  in  Figure  4  is  to  determine  which  target(8) 
each  aircraft  threatens,  and  time  on  target. 

Forecast  of  Targets  Threatened 

The  simple  forecast,  that  each  aircraft  threatens  all  cv  .tical 
targets,  is  open  to  two  modest  refinements;  (a)  a  threat  cone,  and  (b)  a 
maximum  threat  range.  The  latter  can  be  used  to  prevent  consideration  of 
unlikely  situations,  such  as  an  aircraft  approaching  the  east  coast  targeted 
against  a  west  coast  target  (or  vice  versa).  The  threat  cone  limits  lateral 

16 


UNCLASSIFIED 


UNCLASSIFIED 


movements  after  entering  radar  coverage.  For  example,  an  aircraft  nearing  the 
coast  of  Maine  may  not  threaten  southeastern  targets. 

Forecast  of  Time  on  Targets 

Each  of  the  bomber  or  cruise  missile  -  target  pairs  obtained 
In  the  previous  section  la  associated  with  a  pair  of  times  T1  and  T2,  the 
earliest  and  latest  times,  respectively,  that  the  bomber  or  cruise  missile  can 
arrive  at  the  target  from  its  current  position. 

The  earliest  time  of  arrival  is  the  distance  of  the  geodesic  line  between 
each  raid  -  target  pair. 

Later  times  of  arrival  may  result  from  such  factors  as  indirect  routes 
(to  avoid  defenses)  and  lower  speeds.  The  latest  time  of  arrival  is  obtained 
as  earliest  time  of  arrival  plus  a  tolerance  which  is  proportional  to  the 
distance  to  the  target. 

Step  2 

The  second  step  is  to  Identify  which  of  the  bombers  or  cruise 
missile  -  target  pairs  has  the  property  that  they  can  reach  the  target  at  a 
chosen  future  time  T. 

Since  the  earliest  and  latest  times  of  arrival,  T1  and  T2,  have  already 
been  determined  for  each  pair,  it  is  a  simple  matter  to  determine  whether  T  is 
between  T1  and  T2  for  each  pair. 

Step  3 

The  bomber  or  cruise  missile  -  target  pairs  obtained  in  Step  2 
may  describe  one  bomber  or  cruise  missile  attacking  several  targets  or  one 
target  being  attacked  by  several  bombers  or  cruise  missiles.  In  the  case  of 
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one  bomber  or  cruise  missile  attacking  several  targets.  It  Is  necessary  to 
discard  all  but  one  of  the  bomber  or  cruise  missile  -  target  pairs.  This  can 
be  done  In  several  ways.  The  algorithm  of  casting  out  pairs  which  is  used  In 
Step  3  maximizes  NOTTS  (the  number  of  targets  threatened  simultaneously). 

The  number  of  targets  reached  at  the  future  time  T  Is  now  counted  to 
establish  a  new  point  on  the  NOTTS  diagram  (ex.,  see  Figure  1). 

Step  4 

Repetition  of  this  foregoing,  from  the  second  step  for  each  of 
several  future  times  provides  the  points  required  to  complete  one  NOTTS 
diagram.  The  NOTTS  diagrams  may  then  be  examined  to  determine  values  for  the 
NOTTS  indicators  (PEAK,  KURTOSIS,  RIDGE,  PI,  P2,  and  P3). 

Parameter  Settings 

The  raid  recognition  algorithm  contains  a  number  of  parameters  which 
must  be  set  prior  to  carrying  out  an  analysis.  The  effect(8)  of  these 
settings  on  the  NOTTS  Indicator  values  were  examined  prior  to  the  current 
study.  Settings  were  chosen  which  yielded  an  effective  analysis,  and  were 
held  constant  during  the  current  study. 

Scenarios 

The  scheme  shown  In  Figure  4  was  applied  to  collect  Indicator  values 
under  several  situations,  which  are  summarized  In  Figures  8  an  9.  Each  figure 
considers  four  main  cases  which  treat  two  values  of  detection  probability 
(Pp-.90  and  Pjj».50)  and  two  classes  of  target  sets  (the  30  standard  targets 
and  the  13  target  subset  of  the  30).  Figure  8,  however,  deals  with  a  30 
bomber  raid  while  Figure  9  deals  with  a  34  cruise  missile  raid  . 
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(SAC  +  C^) 

Combined 

Combined 

13  Targets 

Background  Alone 

Background  Alone 

Analyzed 

ich 

Combined 

_ 

Combined 

FIGURE  9 

Cruise  Hlssile  Raid 


Background  Effect 

In  each  of  these  cases  the  first  situation  studied  consisted  of 
background  commercial  traffic  alone  (i.e.,  no  hostile  tracks  were  present). 
Five  analyses,  based  on  Figure  A  were  carried  out,  and  In  each  analysis  6X 
of  the  commercial  tracks  were  chosen  at  random  from  369  tracks  and  classified 


19 


UNCLASSIFIED 


UNCLASSIFIED 

as  unknown  (i.e*ij  uncoirrelated  with  flight  plans).  Only  five  analysers  were 
used  due  to  computer  time  constraints^  which  produced  five  values  of  each 
indicator  under  background  conditions. 

Combined  Effect 

The  second  situation  consisted  of  a  raid  in  conjunction  with 
background  traffic.  One  analysis  would  suffice  if  Pq  1  (since  no  random 
numbers  occur  in  this  case);  when  Pq  ■  .90  or  .50,  five  analyses  were  made. 
These  calculations  were  repeated  for  each  of  the}^  main  cases  (Figures  8  and 
9). 

In  the  lower  blocks  13  targets  were  analyzed,  because  although  the 
raid  is  attacking  30  targets,  it  is  not  practical  to  guess  the  complete 
target  set  before  evaluating  the  indicators.  These  cases  will  demonstrate  the 
penalty,  if  any,  in  choosing  to  base  the  analysis  on  sites  alone. 

VII.  RESULTS 

Indicator  Scatter  Charts 

Figure  10  shows  results  for  the  KURTOSIS  indicator  at  two-hour 
intervals.  The  points  marked  by  'B*  are  the  values  with  background  traffic 
(i.e.,  noise)  only.  The  variation  in  the  values  come  from  different  random 
selections  of  tracks  from  the  background  traffic.  The  five  combined  cases 
(raid  and  background)  are  marked  'C.  Figure  10  contains  all  the  values  of 
the  KURTOSIS  Indicator  obtained  for  the  upper  left  corner  on  Figure  8. 

At  time  35  (nine  hours  before  impact)  the  KURTOSIS  values  are  near 
noise  level.  Two  hours  later,  the  values  are  a  little  higher  and  at  41  hours 
they  are  well  above  noise  level. 
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Figure  11  Is  a  similar  presentation  of  the  PEAK  indicator.  The 
indicator  is  well  above  noise  level  at  39  hours  and  remains  high,  until  impact 
at  44  hours,  where  twenty-seven  of  the  thirty  targets  are  indicated. 

Figure  12  shows  values  of  the  RIDGE  indicator.  The  combined  values 
lie  above  background . from  time  39  to  time  of  impact,  r 

A  complete  set  of  these  scatter  diagrams  is  provided  in  Appendix  A. 

Summary  Diagram  (30  Bomber  Raid) 

Figure  13  gives  a  worst  case  summary  of  the  scatter  diagrant;  results 
for  the  30  bomber  raid.  The  first  two  rows  of  Figure  13  Identify  the 
scenarios  from  Figure  8,  and  the  raid  indicators  are  shown  in  the  first 
column.  The  triads  given  in  the  table  are  OASIS  time,  maximum  background 
height  at  this  time,  and  minimum  value  of  combined  height  at  this  time.  For 
example,  the  underlined  entry  for  the  PEAK  indicator  at  OASIS  time  43  shows 
that  the  highest  noise  level  was  13  and  the  lowest  value  with  the  raid  present 
was  24 . 

In  Figure  13,  all  indicators  (KURTOSIS,  PEAK,  AND  RIDGE)  do  not  mix 
raid  and  background  at  time  43.  At  time  41,  however,  all  Indicators  are  not 
lOOS  efficient  in  detecting  a  raid  when  one  is  present  and  not  indicating  a 
raid  when  one  is  absent. 
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TARGETS 
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30 
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41/7-5 

RIDGE 

41/25-48 

41/23-28 

41/17-32 

41/14-19 

FIGURE  13 
Summary  Diagram 
(30  Bomber  Raid) 


Summary  Diagram  (Cruise  Missile  Raid) 

Figure  14  gives  a  worst  case  summary  of  the  scatter  diagram  results 
for  the  cruise  missile  raid,  and  as  in  the  30  Bomber  Raid,  the  KURTOSIS  and 
RIDGE  Indicators  are  not  100%  efficient  at  time  41.  The  PEAK  indicator, 
however,  does  not  mix  raid  and  background  at  time  41  or  43. 
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Figure  14 
Summary  Diagram 
(Cruise  Missile  Raid) 


Reaction  Thresholds 

When  setting  reaction  thresholds,  an  interesting  dilemma  arises;  are 
we  more  concerned  with  the  probability  of  not  detecting  a  raid  when  one  Is 
present,  or  the  probability  of  a  false  alarm?  If  we’re  concerned  with  not 
detecting  a  raid  when  one  Is  present,  the  reaction  threshold  should  be  set  at 
the  minimum  combined  level  (Raid  Detection  Threshold  Level  -ROTL),  which 
guarantees  that  a  raid  will  always  be  detected,  by  any  of  the  Indicators,  when 
one  is  present.  But  if  we're  concerned  with  false  alarms,  the  reaction 
threshold  should  be  set  at  the  minimum  background  level  +1  (False  Alarm 
Threshold  Level-FATL),  which  guarantees  that  a  raid  will  never  be  Indicated 
when  none  Is  presents  A  prudent  person,  however,  would  rather  risk  a  false 
alarm  then  be  caught  unprepared  for  an  actual  raid;  hence,  RDTL  la  of  greater 
concern. 
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Figures  15  and  16  present  both  concerns  (raid  detection  and  false  alarm) 
for  the  30  bomber  and  cruise  missile  raids  at  times  41  and  43.  These  times 
were  chosen  since  both  raids  are  designed  to  have  simultaneous  impact  at  time 
44.  The  first  two  rows  of  Figures  15  and  16  identify  the  case  from  Figure  8, 
and  the  indicators  are  shown  in  the  first  column.  The  values  given  in  the 
table  are  percent  (%)  of  raids  not  detected  and  percent  of  false  alarms  using 
RDTL  and  FATL,  respectively. 

At  time  41,  all  three  Indicators  have  major  problems  with  both  detecting 
a  raid  and  reporting  false  alarms.  These  problems,  however,  are  much  less  for 
reporting  false  alarms  if  we're  concerned  with  raid  detection,  and  as  stated 
earlier,  the  risk  of  being  unprepared  outweighs  the  risk  of  false  alarm. 

By  time  43,  which  is  still  one  hour  before  Impact,  the  KURTOSIS 
indicator  no  longer  has  problems  with  either  raid  detection  or  false  alarm, 
PEAK  has  only  minor  problems  when  working  with  a  smaller  target  set,  and  RIDGE 
appears  to  have  only  one  problem  with  raid  detection  and  false  alarm  for  the 
30  target  set/Pp  •  .90  scenario.  The  RIDGE  problem  may  be  an  outlier,  and 
is  reexamined  in  Appendix  C. 


21 


UNCLASSIFIED 


UNCLASSIFIED 


TIME 


4300 


4100 


TIME 


4300 


4100 


TARGETS 

30 

30 

13 

13 

Pd 

KURTOSIS 

.90 

.50 

.90 

.50 

0-0 

0-0 

0-0 

0-0 

PEAK 

0-0 

0-0 

0-20 

20-20 

RIDGE 

0-0 

20-20 

0-0 

0-0 

KURTOSIS 

0-0 

60-20 

20-20 

60-40 

PEAK 

0-0 

20-20 

20-20 

20-60 

RIDGE 

0-0 

0-0 

0-0 

0-0 

Fig  are  1 5 

Reaction  Thresholds 
(30  Bomber  Raid) 

TARGETS 

30 

30 

13 

13 

Pd 

.90 

.50 

.90 

.50 

KURTOSIS 

0-0 

0-0 

0-0 

0-0 

PEAK 

0-0 

0-0 

0-0 

0-0 

RIDGE 

100-40 

0-0 

0-0 

0-0 

KURTOSIS 

20-20 

20-20 

100-60 

0-0 

FEAK 

0-0 

0-0 

0-0 

0-0 

RIDGE 

100-60 

80-40 

100-40 

0-0 

Flgi-re  16 

Reaction  Thresholds 
(Cruise  Missile  Raid) 


28 

UNCLASSIFIED 


UNCLASSIFIED 


PI.  P2.  and  P3  Results 

Figures  17  and  18  provide  the  frequencies  for  the  probability  of  a 
bomber  or  cruise  missile  raid  being  a  1  on  1 .  2  on  I ,  or  3  on  1  attack.  Since 
the  bomber  raid  was  designed  to  be  a  1  on  1  attack.  PI  should  be  greater  than 

P2,  which  as  shown  in  Figure  17  is  the  case. 

Both  the  bomber  and  cruise  missile  raids  indicate  P2  values  greater  than 

zero,  which  means  that  there  is  the  possibility  of  an  attack  being  a  2  on  1. 

The  P2  indicator,  however,  never  overcomes  the  PI  indicator,  which  means  that 
the  either  raid  is  nost  likely  a  1  on  1  attack,  but  retains  the  "possibility" 
of  being  a  2  on  1  attack.  The  probability  of  either  raid  being  a  3  on  1 
attack  is  essentially  zero. 
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PI,  P2,  and  P3  Frequency  Chart 
for  40  Simulations  of  a 

34  Cruise  Missile  Raid 
(4300  hours  OASIS) 

We  must  remember 

that  all  these  probabilities  are 

just  relative  ' 

should  only  be  referred  to  when 

KURTOSIS,  PEAK,  or 

RIDGE  indicate 

Imminent  attack. 

The  Effect  of  Time  on  Threshold 

The  distribution  of  Inbound  commercial  traffic  shown  in  Figure  7 
indicates  a  very  uneven  flow  of  traffic  during  a  24  hour  period,  with  a 
strong  peak  at  1600-1700  hours  ZULU.  The  effect  of  this  uneven  flow  is  to 
cause  background  values  of  the  indicators  to  vary  with  time  (as  shown  in 
Figures  10,  11,  and  12). 
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Threshold  values  could  be  set  as  a  constant  value  Independent  of  time, 
but  this  would  be  a  bad  method  since  the  setting  would  be  too  high  off-peak. 
Hence,  the  use  of  different  thresholds  for  peak  and  off-peak  conditions  will 
provide  greater  sensitivity.  On  the  basis  of  tl*.ls  study,  hourly  settings  over 
the  period  i200-2000  hours  ZULU  appear  better  still. 

The  Effect  of  Pn  on  Threshold 

Indicator  values  derived  for  Pq  *  .90  and  .50  are  shown  in  Figures  13 
and  14.  Using  Figure  13  at  time  43,  the  PEAK  indicator  has  a  value  of  14  from 
background  noise  and  a  value  of  24  for  noise  plus  raid  when  Pq  .90  (30 
target  case).  The  corresponding  values  when  Pp  *  .50  are  12  and  15.  Since 
Pq  is  known,  scaling  the  Raid  Detection  Threshold  Level  (RDTL)  appears 
appropriate  for  both  rold  designs,  using  Pq  and  a  proportionality  constant. 

The  Pq  value  applied,  however.  Is  an  average  over  all  detection 
sectors.  Various  methods  of  forming  this  average  are  given  in  the  section 
"Probability  of  Detection", 

In  practice,  it  may  prove  useful  in  meeting  other  requirements  to  set 
thresholds  based  on  the  number  of  unknowns  in  each  detection  sector.  These 
will  scale  with  Pq,  but  the  subject  of  this  paper  is  NOTTS  for  which  a  system 
value  of  Pq  seems  necessary. 

The  Effect  of  Target  Set  on  Threshold 

The  two  cases  studied  were  the  SAC  and  target  set  of  30,  and  the 
subset  of  13  targets.  In  Figures  15  and  16,  the  first  two  and  last  two 
columns  can  be  compared  to  examine  this  effect. 
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In  general,  a  penalty  Is  paid  by  restricting  the  analysis  to  a  target 
subset,  which  was  evidenced  with  the  PEAK  indicator.  The  penalty  appears  to 
consist  of  approximately  the  same  background  noise  levels  and  a  smaller  raid 
signal. 

In  Figures  15  and  16  at  time  43,  except  for  the  RIDGE  indicator  which 
may  be  an  outlier,  there  is  no  difficulty  in  recognizing  a  raid  in  the  30 
target  situation.  A  reduction  in  the  target  set  may  cause  difficulty,  but 
this  difficulty  is  avoided  in  this  study  because  the  signal  is  so  strong  for 
the  30  target  case. 

The  Effect  of  Raid  Design  on  Threshold 

The  two  raid  designs  studied  were  the  30  bomber  raid  phased  to 
coincide  with  peak  commercial  traffic,  and  the  34  cruise  missile  raid  designed 
to  have  simultaneous  impact  at  4400  hours  OASIS,  The  cruise  missile  raid 
design  appears  to  have  more  problems  than  the  bomber  raid  design,  especially 
when  concerned  with  false  alarms.  In  fact,  if  false  alarms  have  a  higher 
priority  than  raid  detection  there  are  4  cases  in  Figure  16  in  which  KURTOSIS 
and  RIDGE  do  not  detect  an  actual  raid.  The  KURTOSIS  problem  doesn't  appear 
to  be  a  major  problem  since  it  is  totally  rectified  by  4300  hours  OASIS  (1 
hour  before  Impact).  The  RIDGE  problem,  on  the  other  hand,  continues  through 
4300  hours  under  the  high  Pq  case,  and  as  stated  earlier,  appears  to  be  an 
outlier  and  is  reexamined  in. Appendix  D. 

The  NOTTS  Indicators  have  more  difficulty  recognizing  a  raid  when  one  is 
present  and  not  indicating  a  raid  when  one  is  absent  in  the  cruise  missile 
case,  than  the  bomber  case.  This  appears  to  be  caused  by  only  7  unknowns  in 
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radar  coverage  suddenly  becoming  34  unknovms  in  the  cruise  missile  case;  while 
in  the  30  bomber  case  all  30  are  classified  as  unknowns  as  soon  as  they  enter 
radar  coverage.  Due  to  this  delay  In  the  OTHB  coverage  recognizing  the  cruise 
missile  raid,  the  NOTTS  indicators  do  not  exceed  the  reaction  thresholds  until 
one  hour  before  Impact  (4400  hours  OASIS);  hence,  the  cruise  missile  raid  is 
performing  Its'  mission  effectively. 

VIII.  LIMITATIONS 

These  results  are  the  best  obtainable  at  present,  since  limitations 
are  unavoidable.  Background  coounerclal  traffic  may  fluctuate  more  than 
indicated.  The  OTHB  detection  zone  and  tracking  zone,  the  Pq  values  and 
correlation  probability  all  correspond  to  examples  of  ERS  experience. 

However,  fluctuations  are  not  well  documented. 

The  possibility  of  cross-correlation  between  Pq  and  Pq  Is  not  documented 
and  Its  consideration  has  been  omitted. 

Only  five  simulations  of  each  case  in  Figures  8  and  9  were  performed  due 
to  computer  time  constraints,  and  additional  runs  might  have  provided  further 
Insight  Into  the  setting  of  reaction  thresholds. 

pQ  «  .90  and  .50  were  the  only  detection  probabilities  examined,  and 
other  Pq's  such  as  .70  could  be  evaluated. 

Finally,  It  has  been  assumed  that  members  of  the  bomber  and  cruise 
missile  raids  are  classified  as  unknown.  Yet  the  ocean  flight  plan 
registration  Is  not  secure. 
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IX.  CONCLUSIONS 

(1)  Four  indicators  of  the  presence  of  a  possible  raid  have  been  evaluated 
using  a  simulated  data  bank  of  unknowns  and  the  J5YA  raid  recognition 
algorithm. 

(2)  The  examples . used  in  the  evaluation  were  a  30  bomber  raid  phased  to 
coincide  witlv  maximum  (incoming)  background  traffic,  and  a  34  cruise 
missile  rald^ designed  to  have  simultaneous  Impact  at  4400  hours  OASIS. 

(3)  All  four  indicators;  PEAK,  KURTOSIS,  RIDGE,  and  PI,  P2,  and  P3  performed 
well  for  4300  hours  OASIS,  which  is  one  hour  before  impact. 

(4)  Vfhen  presented  with  a  choice  between  raid  detection  and  false  alarm  as  the 
primary  concern,  raid  detection  is  the  wise  choice  and  the  Raid  Detection 
Threshold  Level  (RDTL)  should  be  used.  The  values  on  the  left  side  of 
Figures  15  and  16  indicate  very  low  percentages  of  false  alarm  when  RDTL 
is  used,  especially  at  4300  hours  OASIS  and  high  Pq. 

(5)  Background  and  combined  values  of  the  indicators  were  determined  for 
detection  probabilities  of  .90  and  .50,  and  for  bomber  and  cruise  missile 
raids. 

(6)  Effects  of  time  of  day,  Pq,  and  target  set  on  reaction  threshold  settings 
were  discussed.  Reaction  threshold  should  vary  with  time  of  day,  and 
scale  proportionately  with  Pp  value. 

(7)  Applications  to  small  subsets  of  critical  targets  is  not  recommended 
since  the  background  signal  decreases  more  slowly  than  the  raid  plus 
background  signal. 
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(8)  The  results  of  this  study  are  necessarily  preliminary  in  nature.  Further 
information  on  the  variability  in  background  traffic  and  in  detection  and 
classification  by  OTHB  is  required. 

X.  RECOMMENDATIONS 

(1)  Analyze  additional  simulations  of  the  cases  outlined  in  Figures  8  and  9 
to  possibly  obtain  more  accurate  estimates  of  raid  detection  and  false 
alarm  using  FATL  and  RDTL,  respectively. 

(2)  Continue  analysis,  using  different  values  of  Pp,  to  evaluate  the 
sensitivity  of  reaction  thresholds  to  Pj). 

<3)  Obtain  additional  raid  designs  to  further  evaluate  the  effect  of  raid 
design  on  reaction  thresholds. 
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APPENDIX  A 


Additional  Scatter  Charts 
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SCATTER  PLOT-KORTOSIS 
(P[)».5Q,  30  Targets,  30  tomber  Raid) 
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SCATTER  PLOT-KURTOSIS 
(Pp**»90,  13  Targets,  30  Bomber  Raid) 
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SCATTER  PLOT-KURTOSIS 
(Po“»50,  13  Targets,  30  Bo'Jiber  Raid) 
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SCATTER  PLOT-RIDGE 
(Po*«50,  13  Targets,  30  Bomber  Raid) 
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APPENDIX  B 


OTHB  and  NWS  Radar  Coverage 
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OTHB  and  NWS  Radar  Coverage 

Figure  19  depicts  the  OTHB  and  IIWS  radar  cover  of  North  America  simulated 
for  this  report.  The  OTHB  radar  system  which  covers  both  the  east  and  west 
coasts  can  initially  "detect"  an  object  at  a  range  of  170C  nautical  miles  (nm) 
and  begins  "tracking”  at  1300  nm.  Tracking  continues  until  a  range  of  500  nm 
The  simulation  divides  the  OTHB  radar  cover  into  7®  sectors,  and  it  is  assumed 
that  the  radar  has  the  ability  to  deteci  any  object  above  ground  level.  The 
NWS  only  "detects"  objects  and  does  not  perform  any  "tractcing"  functions.  The 
initial  detection  range  is  1A80  nm,  and  the  NWS  continues  to  detect  until  a 
range  of  1080  nm. 
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APPENDIX  C 


RIDGE  Outlier  Reexamined 
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RIDGE  Outlier  Reexamined 

This  appendix  reexamines  the  RIDGE  indicator  for  the  30  target  set/Pj,  = 
.90  scenario  since  as  stated  In  the  body  of  this  report,  it  appears  to  be  an 
outlier.  Figure  20  provides  a  worst  case  summary  for  an  additional  five  runs 
of  this  scenario,  where  the  triads  represent  OASIS  time,  maximum  background 
height,  and  minimum  value  of  the  combined  height,  respectively.  As  was  the 
case  with  the  outlier,  KURTOSIS  and  RIDGE  have  problems  discriminating 
commercial  traffic  and  an  actual  raid  at  time  41.  By  time  43,  however,  this 
problem  has  all  but  disappeared. 

Examining  Figure  21  provides  further  insight  into  the  problems  realized 
in  Figure  20.  The  values  in  Figure  21  are  percent  of  raids  not  detected  if 
false  alarm  is  our  major  concern,  and  percent  of  false  alarms  if  detecting  an 
Immenent  raid  has  a  higher  priority,  respectively.  The  difficulty  KURTOSIS 
and  RIDGE  have  In  both  detecting  a  raid  and  reporting  a  false  alarm  at  time 
41,  is  rectified  by  4300  hours.  At  this  time,  RIDGE  has  only  a  20%  chance  of 
not  detecting  a  raid  when  false  alarm  is  of  prime  concern  and  never  registers 
a  false  alarm  when  raid  detection  is  of  ultimate  Importance.  Based  upon  these 
additional  five  runs,  it  appears  that  the  RIDGE  values  from  the  firs' 
simulation  was.  Indeed,  an  outlier. 
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Figure  20 
Sunmary  Diagram 
(RIDGE  Outlier) 
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Figure  21 

Reaction  Thresholds 
(RIDGE  Outlier) 
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